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jl MICROPROCESSOR, 

;il " 

1 3 by inventor(s) Linus Torvalds. Robert Bedichek, and Stephen Johnson, 
T described in 

U [ X ] the specification being filed herewith, 

] ~i and 1 have reviewed the document that evidences the conveyance of those rights . That 
document 

2; t X ] is being filed herewith. 

If the rights held by the above-identified small business concern are not exclusive, each individual, 
concern or organization having rights to the invention is listed below and no rights to the invention 
are held bv anv person, other than the inventor, who couid not qualify a s a small business 
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A METHOD FOR TRANSLATING INSTRUCTIONS IN A SPECULATIVE 


MICROPROCESSOR 


BACKGROUND OF THE INVENTION 
Field Of The Invention 

5 This invention relates to computer systems and, more particularly, to 
methods for increasing the efficiency of operation of a microprocessor 
which dynamically translates instructions from a target to a host 
instruction set and speculates on translated branch operations. 

History Of The Prior Art 

; fl 10 Recently, a new microprocessor was developed which combines a simple 
but fast host processor (called a "morph host") and software (referred to 

1 as "code morphing software") to execute application programs designed 
□ for a processor (the "target processor") having an instruction set different 
L than the morph host processor. The morph host processor executes the 

2 15 code morphing software which translates the target programs 

% dynamically into morph host processor instructions which are able to 

0 accomplish the purpose of the original target software. As the target 

instructions are translated, the new host instructions are both executed 
and stored in a translation buffer where they may be accessed without 
20 further translation. Although the initial translation of a program is slow, 
once translated, many of the steps normally required by prior art 
hardware to execute a program are eliminated. The new microprocessor 
has demonstrated that a simple fast low-powered processor is able to 
execute translated "target" instructions at a rate equivalent to that of the 
25 "target" processor for which the programs were designed. 
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In order to be able to execute programs designed for other processors at 
a rapid rate, the morph host processor includes a number of hardware 
enhancements. One of these enhancements is a gated store buffer which 
holds memory stores generated as sequences of morph host instructions 
are executed. A second enhancement is a set of host registers which 
store state of the target processor at the beginning of any sequence of 
target instructions being translated. If the translated morph host 
instructions execute without raising an exception, the target state at the 
beginning of the sequence of instructions is updated to the target state at 
the point at which the sequence completed and the memory stores are 
committed to memory. 

If an exception occurs during the execution of the sequence of host 
instructions which have been translated, processing stops; and the entire 
operation may be returned or rolled back to the beginning of the 
sequence of target instructions at which known state of the target 
processor exists. This allows veiy rapid and accurate handling of 
exceptions while dynamically translating and executing instructions. 

It will be noted that the method by which the new microprocessor 
handles the execution of translations by placing the effects in temporary 
storage until execution has been completed successfully is effectively a 
rapid method of speculating. The new microprocessor, in fact, uses the 
same circuitry for speculating on the outcome of other operations. For 
example, by temporarily holding the results of execution of sequences of 
instructions reordered by a software scheduler from naively translated 
sequences of instructions, more aggressive reordering may be 
accomplished than has been attempted by the prior art. When such a 
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reordered sequence of instructions executes to produce a correct result, 
the memory stores resulting from execution of the reordered sequence 
may be committed to memory and target state may be updated. If the 
reordered sequence generates an exception while executing, then the 
5 state of the processor may be rolled back to target state at the beginning 
of the sequence and a more conservative approach taken in translating 
the sequence. 

One of the most advantageous features of the new microprocessor is its 
ability to link together short sequences of target instructions which have 

10 been translated and found to execute without exception to form longer 
sequences of instructions. This allows a translated program to be 
executed at great speed because the microprocessor need not look up 
each of the shorter translated sequences or go through all of the steps 
normally taken by hardware processors to execute instructions. Even 

15 more speed may be attained than might be expected because, once long 
sequences are linked, it is often possible for an optimizer to eliminate 
many of the steps without changing the results produced. Hardware 
optimizers have never been able to optimize sequences of instructions 
long enough to allow the patterns which allow significant optimization to 

20 become apparent (such as loops). 

The original method of speculation used by the new processor always 
updated the state of the target processor by committing stores to memory 
from the gated store buffer and transferring new state to target registers 
at the end of a sequence of instructions which had executed correctly 
25 and before any next sequence of target instructions was translated. This 
method of updating state is effective for many situations. 
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However, there are certain characteristics of the method which are less 
useful in certain circumstances. First, it is usually desirable to execute 
sequences which are as long as possible. In order to obtain long 
sequences of instructions between commits, it is often necessary to 

5 include one or more branch instructions which are not immediately 
followed by a commit instruction. This may occur when the code 
morphing software sees that a branch is taken almost all of the time and 
decides to treat the branch usually taken as the normal path for 
execution. The code morphing software speculates that this is the path 

10 which will be taken and omits a commit instruction after the branch 
instruction in order to provide longer sequences which may be further 
optimized. However, since there are no commit instructions immediately 
following each internal branch instruction at which the state of the target 
processor is committed before a branch is taken, if an exception occurs 

15 at some point during the execution of the sequence after an internal 

branch is taken, the operation of the machine must be rolled back to the 
beginning of the initial sequence preceding the branch instruction which 
is the last point at which correct state of the target processor exists. This 
may be quite time consuming. 

20 Second, the original method of committing stores to memory while 
speculating on sequences of host instructions is useful because it is 
desirable to create translations which are as long as possible in order to 
accelerate execution. However, sequences of instructions can result from 
the taking of branches within sequences not followed by commit 

25 instructions which are so long that the number of memory stores are too 
great for the finite length of the gated store buffer used to accomplish 
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speculation. This causes execution to halt,rollback to occur, and shorter 
sequences of instructions to be generated, a process which slows 
execution. 

Another problem caused by this original method of committing stores to 
memory at the end of translated sequences occurs in cases in which all 
of the steps of some portion of the sequence must be completed 
sequentially without interruption in order that the result desired be 
produced. Input/ output operations are often an example of such 
sequences. In such cases, it is typical to lock out interrupts until the 
sequence is finished. However, the lockout must be released at the end 
of the sequence in order to realize the full benefits of optimization. 
However, an unlock cannot occur without a commit because any 
asynchronous interrupt which was attempted during the locked stages of 
the sequence but was delayed by the lock would be generated and cause 
execution to be rolled back to the last known correct state. This could 
cause operations such as input/ output to be repeated which could 
violate symantics of the system. 

It is desirable to improve provide a new method of translating sequences 
of instructions by which the speed of the new microprocessor is 
maintained or increased. 

Summary Of The Invention 

It is, therefore, an object of the present invention to accelerate execution 
by a microprocessor capable of running application programs designed 
for other microprocessors. 
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This and other objects of the present invention are realized by a method 
for use by a host microprocessor which translates sequences of 
instructions from a target instruction set for a target processor to 
sequences of instructions for the host microprocessor comprising the 

5 steps of beginning execution of a first sequence of target instructions by 
committing state of the target processor and storing memory stores 
previously generated by execution at a point in the execution of target 
instructions at which state of the target processor is known, executing 
the speculative sequence of host instructions until another point in the 

10 execution of target instructions at which state of the target processor is 
known, rolling back to last committed state of the target processor and 
discarding memory stores resulting from the speculative sequence of host 
instructions if execution fails, and beginning execution of a next 
sequence of target instructions if execution succeeds by committing state 

15 of the target processor and storing memory stores previously generated. 

These and other objects and features of the invention will be better 
understood by reference to the detailed description which follows taken 
together with the drawings in which like elements are referred to by like 
designations throughout the several views. 

20 Brief Description Of The Drawings 

Figures 1 is a diagram illustrating a method for translating instructions 
which has been practiced in previous versions of the new 
microprocessor. 
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Figure 2 is a diagram illustrating a method for translating instructions 
practiced in the new microprocessor in accordance with the present 
invention. 

Figure 3 is another diagram illustrating a method for translating 
5 instructions practiced in the new microprocessor in accordance with the 
present invention. 

Figure 4 is another diagram illustrating another method for translating 
instructions practiced in the new microprocessor in accordance with the 
present invention. 

10 Detailed Description 

Referring now to Figure 1, there is illustrated a diagram describing the 
execution of a sequence of instructions. The key at the lower left of the 
figure provides definitions for portion of the figures. A straight line 
ending in an arrow represents a single sequence of translated 

15 instructions which is being executed. A circle represents a commit 
operation. As a sequence of instructions has typically been executed 
using the new microprocessor before the present invention, the sequence 
of instructions is executed from its beginning at point 10 and continuing 
to its end at point 1 1 at which a commit operation occurs. This is 

20 represented by the left uppermost sequence starting at "begin" and 
continuing straight down to a "commit/' In executing such a short 
sequence, various state of the operation existing immediately prior to the 
"begin* point (which is a last point at which state of the target operation 
is known) is recorded. When the execution of the sequence concludes at 
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the commit operation just beyond point 11, the necessary state of the 
operation at the commit point is saved. 

If, in a short sequence of instructions including a branch operation, the 
branch occurs at the end of the sequence, proper state of the target 
5 processor is committed just before the execution of the branch sequence 
occurs. Consequently, an exception occurring in either branch has the 
effect of rolling the operation back to the commit point where correct 
state exists immediately before execution of the branch sequence 
commences. 

10 However, it is possible that in the sequence of target instructions 
execution of a branch operation will commence without a commit 
operation. For example, the translation and optimization software may 
speculate that one branch will almost always be taken in and consider 
that direction as the normal direction of the sequence of instructions. In 

15 such a case, the software may create a sequence in which the state 

existing at an exit point is not committed. The sequence to the upper left 
in the figure beginning at point 10 and providing a branch at point 12 to 
a second sequence is such a sequence. In such a sequence, no commit 
operation occurs before the branch because the translation software 

20 determines that the sequence from point 10 to point 1 1 will probably 
usually be executed and omits the commit in order to accelerate 
execution. 

When a sequence includes a branch operation which is taken in such a 
case, execution branches to the second sequence without a commit 
25 operation at the branch, and the branch sequence commences executing 
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at its beginning instruction (e.g., point 13). The earliest possible point at 
which a commit may occur is at the conclusion of the branch sequence 
at point 14. Even this commit will not occur if the branch sequence also 
includes a branch operation before its end which branch is taken (as in 
5 the third sequence to the far right in Figure 1). As may be seen, this 
offers the possibility of sequences of translations which are of 
unbounded length before a commit occurs. 

Because the translation path may thus be too long between commit 
points if branches are taken at intermediate points in execution 

10 sequences, the number of memory stores which have not yet been 

committed may be too large when a commit point is finally reached. In 
fact, the number of executed store instructions may be larger than there 
is room for storage in the gated store buffer. If this occurs, provision 
must be made to assure that data will not be lost. Consequently, it has 

15 been necessary for the translator and optimizer to be more conservative 
in placing branches in the middle of sequences of translations. This has 
effectively produced optimized code which executes more slowly. 

A second problem creating by the old process is that if a number of 
branches are taken in a sequence of instructions being executed at 
20 points at which target state is uncommitted and a failure occurs during 
execution at some point after a large number of instructions have been 
executed, then a great deal of time will have been wasted in executing 
instructions before rolling back to the last point at which a commit 
occurred and then retranslating from that point. 
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Another problem caused by this original method of committing stores to 
memory at the end of translated sequences occurs in cases in which all 
of the steps of some portion of the sequence must be completed 
sequentially without interruption in order that the result desired be 

5 produced. Input/ output operations are often an example of such 

sequences. In such cases, it is typical to lock out interrupts until the 
sequence is finished. However, the lockout must be released at the end 
of the sequence in order to realize the full benefits of optimization. 
However, an unlock cannot occur without a commit because any 

10 asynchronous interrupt which was attempted during the locked stages of 
the sequence but was delayed by the lock would be generated and cause 
execution to be rolled back to the last known correct state. This could 
cause operations such as input/ output to be repeated which could 
violate symantics of the system. 

15 The present invention obviates these problems of the original process. 

Figure 2 illustrates a linked set of sequences of translations utilizing the 
process of the present invention. In this new process, at the beginning of 
a new sequence before any execution of target instructions has taken 
place, a commit instruction stores the present state of the operation 

20 including any memory stores generated by previous correctly-executed 
sequences of translated instructions. Thus, when a earlier sequence 
includes a branch instruction, if that branch is taken to a new sequence 
of instructions, then the new sequence of instructions begins with a 
commit operation. If the branch is not taken, the sequence continues to 

25 its end at which state of the target processor is known. At this point, 
execution of a new sequence commences beginning with a commit 
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operation which commits the known state and stores the memory stores 
generated by execution of the previous sequence. 

The new process produces a correct result. The state of the target 
processor which exists after the sequence of instructions ending at the 
branch point is committed after the decision on the branch to be taken 
and just prior to beginning the execution of the next sequence of 
translated instructions. To have arrived at a new sequence of 
instructions to be translated following the branch, the preceding 
sequence of instructions must have been executed without error by the 
new microprocessor. If the preceding sequence of instructions had not 
executed correctly, then the attempt to execute would have generated an 
interrupt causing a rollback; and the host would not be at the branch to 
begin translating instructions of the branch sequence. Consequently, 
correct execution of the translated instructions has occurred, and the 
new target state and memory stores generated by execution may be 
committed. 

The new process has a number of benefits. First, the length of any 
sequence of stores which occurs between commit points can only be as 
long as the longest individual sequence of instructions in a sinlge 
translations from the initial point at which the last commit occurred 
(e.g., point 20 to point 21 in Figure 2). Thus the sequence of stores is 
bounded. This allows close control over the number of uncommitted 
stores which may reside in the gated store buffer so that overflow of the 
store buffer is rare. 
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Second, since a commit occurs whenever a branch is taken at the 
beginning of execution of the next sequence of instructions following the 
branch, there are no uncommitted branch operations. Thus, if an 
exception occurs which necessitates a rollback operation after a branch 
5 is taken, the amount of work the processor has done which is discarded, 
number of stores which must be discarded are limited in numb. Thus 
erthe delay attendant on a rollback is significantly reduced. 

The new process also allows a locking operation to be started and 
released without generating an undesirable rollback operation or 
10 extending the processing mode under the lock for an indefinite period. 
J Figure 3 illustrates a number of sequences of translated instructions 

5 which include a portion in which a set of instructions must be carried 

,« out under a lock in order to execute correctly. In order to initiate the 

S lock, the translator generates a locking instruction. From this point until 

r , 15 the sequence reaches a branch instruction, the process translates 
P instructions in sequential order without reordering or optimization (other 

W than such as might have been tested before the lock began). At the 

'■is. J: 

! fl branch where the process should be released from the lock, one of the 

branches is taken. After the branch is taken, whichever path is followed, 

20 a commit occurs when the new sequence begins to execute. The commit 
operation saves the known state at the point of the commit so that a 
rollback does not discard a correct translation. Then, the selected 
branch executes an unlock instruction to release the sequence from the 
need to execute instruction sequentially. Execution of the remainder of 

25 the branch sequence of instructions continues from that point. 
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In order to assure that an unlock occurs as soon as the sequence 
requiring a lock has completed, an indication of the lock state of the 
operation is stored with state at each commit. In one embodiment, this 
indication is a single bit which is stored in a context register of the host 

5 processor. This lock indication is determined at the beginning of the 

sequence and is indicative of the state which exists during the sequence. 
This lock indication is utilized with other state of the operation (including 
target state) to determine at the next commit point the sequence of 
instructions which is next to follow. That is, a next sequence must 

10 provide an unlock instruction for terminating the locked condition in 

order to qualify as a sequence which can occur next in order. Either of 
the branches which the execution can next execute should be of this 
form. 

It is possible for other methods of processing than the preferred method 
15 to be utilized by combining aspects of the previous process and the 

preferred embodiment. For example, Figure 4 illustrates a process which 
combines features of the two processes and provides certain advantages. 
The process illustrated utilizes commits which occur at the end of a 
sequence of instructions for sequences of instructions which include a 
20 locking operation. All other sequences of instructions commit at the 

beginning of an operation in the manner of this invention. A sequence of 
instructions which includes an uninterruptable portion usually requires 
that the instructions of the sequence be executed in order, which 
precludes most optimization. Thus, though the order of the sequence 
25 cannot be varied, additional commits may be added to the sequence 

because they do not vary the locked sequence. By placing a commit at 
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the end of the sequence and then removing the lock, state relating to the 
lock may be contained within a single sequence of instructions. This has 
the advantage of allowing state for a sequence of translations to be 
treated as local for uninterruptable operations. The other translated 
sequences of operations are carried out in the manner described above 
with the effect described. 

Although the present invention has been described in terms of a 
preferred embodiment, it will be appreciated that various modifications 
and alterations might be made by those skilled in the art without 
departing from the spirit and scope of the invention. The invention 
should therefore be measured in terms of the claims which follow. 

What Is Claimed Is: 
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1 Claim 1. A method for use by a host microprocessor which translates 

2 sequences of instructions from a target instruction set for a target 

3 processor to sequences of instructions for the host microprocessor 

4 comprising the steps of: 

5 beginning execution of a first sequence of target instructions by 

6 committing state of the target processor and storing memory stores 

7 generated by previously-executed sequences of instructions at a point in 

8 the execution of instructions at which state of the target processor is 

9 known, 

10 beginning execution of a speculative sequence of host instructions 

1 1 following a branch from the first sequence of target instructions by 

12 immediately committing state and storing memory stores, 

13 attempting to execute the speculative sequence of host instructions until 

14 another point in the execution of target instructions at which state of the 

15 target processor is known, 

16 rolling back to last committed state of the target processor and 

17 discarding memory stores generated by the speculative sequence of host 

18 instructions if execution fails, and 

19 beginning execution of a next sequence of target instructions if execution 

20 succeeds. 

1 Claim 2 A method as claimed in Claim 1 including an additional step 

2 of releasing a lock for any sequence of host instructions running in a 

3 locked condition immediately after committing state of the target 
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4 processor and storing memory stores generated by previously-executed 

5 translation sequences. 

1 Claim 3. A method for use by a host microprocessor which translates 

2 sequences of instructions from a target instruction set for a target 

3 processor to sequences of instructions for the host microprocessor 

4 comprising the steps of: 

5 beginning execution of a first sequence of target instructions by 

6 committing state of the target processor and storing memory stores 

7 generated by previously-executed sequences of instructions at a point in 

8 the execution of instructions at which state of the target processor is 

9 known, 

10 executing a sequence of host instructions from the first sequence of 

1 1 target instructions commencing immediately after committing state of the 

12 target processor and storing memory stores previously generated by a 

13 execution until another point in the translation of target instructions at 

14 which state of the target processor is known, 

15 beginning execution of a next sequence of target instructions by 

16 committing state of the target processor and storing memory stores 

17 generated by the execution of the first sequence of target instructions at 

18 a point in the execution of target instructions at which that state is 

19 known, and 

20 executing a sequence of host instructions from the next sequence of 

21 target instructions commencing immediately after committing state of the 

22 target processor and storing memory stores generated by the execution of 
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23 the first sequence of target instructions until another point in the 

24 execution of target instructions at which state of the target processor is 

25 known. 

1 Claim 4. A method for use by a host microprocessor which translates 

2 sequences of instructions from a target instruction set for a target 

3 processor to sequences of instructions for the host microprocessor 

4 comprising the steps of: 

5 translating a first speculative sequence of host instructions from the first 

6 sequence of target instructions from a point in the translation of target 
□ 7 instructions at which state of the target processor is known, 

ass 

8 ending the first sequence of target instructions in response to 

; .Hj 9 encountering a branch from the first sequence in the target program by: 

10 branching to a branch sequence of target instructions, 

11 committing state of the target processor and storing memory stores 
W 12 generated by the first translation sequence after a branch taken 

] D 13 before executing a branch sequence of host instructions, and 

14 ending execution of the first sequence of target instructions if a branch is 

15 not taken from the first sequence by: 

16 rolling back to last committed state of the target processor and 

17 discarding memory stores generated by the speculative sequence of 

18 host instructions if execution fails, and 
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19 committing state of the target processor and storing memory stores 

20 generated by the first sequence at the end of the sequence of target 

21 instructions at which state of the target processor is known. 
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Abstract of the Disclosure 

A method for use by a host microprocessor which translates sequences of 
instructions from a target instruction set for a target processor to 
sequences of instructions for the host microprocessor including the steps 

5 of beginning execution of a speculative sequence of target instructions by 
committing state of the target processor and storing memory stores 
previously generated by execution at a point in the execution of 
instructions at which state of the target processor is known, executing 
the speculative sequence of host instructions until another point in the 

10 execution of target instructions at which state of the target processor is 
known, rolling back to last committed state of the target processor and 
discarding the memory stores generated by the speculative sequence of 
host instructions if execution fails, and beginning execution of a next 
sequence of target instructions if execution succeeds. 
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As a below named inventor, I hereby declare that: 

My residence, post office address and citizenship are as stated below, next to my 
name. 

I believe I am the original, first, and sole inventor (if only one name is listed below) or an 
original, first, and joint inventor (if plural names are listed below) of the subject matter 
which is claimed and for which a patent is sought on the invention entitled 

A METHOD FOR TRANSLATING INSTRUCTIONS 
IN A SPECULATIVE MICROPROCESSOR 

the specification of which is attached hereto. 

I hereby state that I have reviewed and understand the contents of the above-identified 
specification, including the claim(s), as amended by any amendment referred to above. 
I do not know and do not believe that the claimed invention was ever known or used in 
the United States of America before my invention thereof, or patented or described in 
any printed publication in any country before my invention thereof or more than one 
year prior to this application, that the same was not in public use or on sale in the 
United States of America more than one year prior to this application, and that the 
invention has not been patented or made the subject of an inventor's certificate issued 
before the date of this application in any country foreign to the United States of America 
on an application filed by me or my legal representatives or assigns more than twelve 
months (for a utility patent application) or six months (for a design patent application) 
prior to this application. 

I acknowledge the duty to disclose all information known to me to be material to 
patentability as defined in Title 37, Code of Federal Regulations, Section 1.56. 

I hereby appoint Stephen L. King, Reg. No. 19,180; with offices located at 30 Sweetbay 
Road, Rancho Palos Verdes, California 90275, telephone (310) 377-5073, with full 
power of substitution and revocation, to prosecute this application and to transact all 
business in the Patent and Trademark Office connected herewith. 

I hereby declare that all statements made herein of my own knowledge are true and 
that all statements made on information and belief are believed to be true; and further 
that these statements were made with the knowledge that willful false statements and 
the like so made are punishable by fine or imprisonment, or both, under Section 1001 of 
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Title 18 of the United States Code and that such willful false statements may jeopardize 
the validity of the application or any patent issued thereon. 


Full Name of Sole/First Inventor Linus Torvalds 


Inventor's Signature U — ^ Date l 0 ) 0 ^) 

Residence Santa Clara, California Citizenship Finland 

(City, State) (Country) 

Post Office Address 1 050 Woodduck Avenue 
Santa Clara, California 95051 


Full Name of Second/Joint Inventor Robert Bedichek 

Inventor's Signature {Rj^^£^^/J> Date f2 ( f?7? 

Residence Palo Alto, California Citizenship U.S.A. 

(City, State) (Country) 

Post Office Address 2951 South Court 

Palo Alto, California 94306 


Full Name of Third/Joint Inventor Stephen Johnson 

Inventor's Signature ^AMA^ \. QVWvwvv Date ^Q ft ^ ft?? 


Residence Los Gatos, California Citizenship U.S.A. 

(City, State) (Country) 

Post Office Address 18769 Favre Ridge Road 
Los Gatos, California 95033 
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